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Abstract 

Chung, Diaconis, and Graham considered random processes of the 
form Xn+i = 2Xn + b„ (mod p) where Xo = 0, p is odd, and bn for 
n = 0, 1, 2, . . . are i.i.d. random variables on { — 1, 0, 1}. If Pr(6„ — —1) = 
Pr(6„ = 1) = /3 and Pr(6„ = 0) = 1 - 2/3, they asked which value of (3 
makes X„ get close to uniformly distributed on the integers mod p the 
slowest. In this paper, we extend the results of Chung, Diaconis, and 
Graham in the case p = 2* — 1 to show that for < l3 < 1/2, there is no 
such value of f3. 



1 Introduction 

In [Tj, Chung, Diaconis, and Graham considered random processes of the form 
Xn+i = 2Xn + bn (mod p) where p is an odd integer, Xq = 0, and 5o, 6i, 62, • ■ ■ 
are i.i.d. random variables. This process is also described in Diaconis [2], and 
generalizations involving random processes of the form Xn+i = cLnXn + bn 
(mod p) where (a.^, bi) for i = 0, 1, 2, . . . are i.i.d. were considered by the author 
in [3] and [1]. A question asked in [Ij concerns cases where Pr(6„ = 1) = Pr(6„ = 
-1) = f3 and Pr(6„ = 0) = 1-2^. If ^ = 1/4 or /3 = 1/2, then P„ is close to the 
uniform distribution (in variation distance) on the integers mod p if n is a large 
enough multiple of logp where Pn{s) — Pr(X„ = s). li (3 = 1/3, however, for 
n a small enough multiple of (logp) log(logp), the variation distance — U\\ 
is far from for certain values of p such as p = 2* — 1. Chung, Diaconis, and 
Graham comment "It would be interesting to know which value of (3 maximizes 
the value of N required for ||P/v — C^ll 0." 

li (3 = 0, then Xn ~ with probability 1 for all n. Thus we shall only 
consider the case f] > 0. We shall show that unless /3 = 1/4 or /3 = 1/2, then 
there exists a value cp > such that for certain values of p (namely p — 2* — 1), 
if n < cp{logp) log(logp), then ||P„ — ?7|| ^ 1 as < ^ cx). Furthermore, one can 
have c/3 ^ 00 as /? 0+. Work of the author [3J shows that for each /?, there is 
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a value such that if n > c^(logp) log(logp), then ||P„ — [7|| as p — > oo. 
Thus one may conclude that there is no value of [3 which maximizes the value 
of TV required for \\Pn ~ U\\ 0. 

This paper will consider a broader class of distributions for bn- In particular, 
Pr(6„ = 1) need not equal Pr(&„ = —1). The main argument here relies on a 
generalization of an argument in [T]. 

2 Notation and Main Theorem 

Recall that the variation distance of a probability P on a finite group G from 
the uniform distribution on G is given by 

sGG 

= max|P(^)-C/(A)| 

J2 \Pis)-l/\G\\ 

s:Pis)>l/\G\ 

The following assumptions are used in the main theorem. Suppose Pr(6„ = 
1) = a, Pr(6„ — 0) = b, and Pr(&„ = —1) = c. We assume a + b + c — 1 and 
a, b, and c are all less than 1. Suppose 60,61,62,... are i.i.d. and Xq = 0. 
Suppose Xn+i — 2X„ + 6„ (mod p) and p is odd. Let P„(s) — Pr(X„ — s). 
The theorem itself follows: 

Theorem 1 Case 1: Suppose either 6 = and a = c= 1/2 or 6 = 1/2. // 
n > ci log2P where ci > 1 is constant, then ||P„ — C/|| — > as p 00 where p 
is an odd integer. 

Case 2: Suppose a, b, and c do not satisfy the conditions in Case 1. Then 
there exists a value C2 (depending on a, 6, andc) such that ifn < C2(logp) log(logp) 
and p = 2* — 1, then ||P„ — U\\ — > 1 as t 00. 



3 Proof of Case 1 

First let's consider the case where 6 = 1/2. Then 6„ = e„ + d„ where e„ and 
d„ are independent random variables with Pr(e„ = 0) = Pr(e„ = 1) = 1/2, 
Pr(d„ = -1) = 2c, and Pr(d„ = 0) = 2a. (Note that here a + c = 1/2 = 6. 
Thus 2a + 2c = 1.) Observe that 

n-1 



X„ = E2"-i-^6j (modp) 



n— 1 n— 1 



= ^2"-i-^ej +E2"-i-Jdj- (modp) 
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Let 

n-l 

y„ = ^ 2"-i-J"e, (modp). 

3=0 

If Pn is the probability distribution of Xn (i.e. P„(s) = Pr(X„ = s)) and 
Qn is the probabihty distribution of y„, then the independence of e„ and (i„ 
imphes — C/|| < — U\\. Observe that on the integers, J2]=o 2"~^~-'ej is 
uniformly distributed on the set {0, 1, . . . , 2" — 1}. Each element of the integers 
mod p appears either [2"/pJ times or \2"/p] times. Thus 

If n > cilogaP where ci > 1, then 2" > p'^i and ||Q„ - U\\ < ^ as 

p ^ oo. 

The case where 6 = and a — c — 1/2 is alluded to in P] and left as an 
exercise. □ 



4 Proof of Case 2 

The proof of this case follows the proof of Theorem 2 in 1 with some modifi- 
cations. First we assume & > 0. 

Define, as in [T], the separating function / : Z/pZ ^ C by 

j=o 

where q :— q{p) :— e^'^^lv _ We shall suppose n = rt where r is an integer of the 
form r = S log t — d for a fixed value 6. 
If < j < i - 1, define 



Note that if a = 6 = c= 1/3, then this expression is the same as Ilj defined in 
the proof of Theorem 2 in [T] . 

As in the proof of Theorem 2 in [1] , Eu {f) — and Ejj [f f) = t. Furthermore 

EpM) = 5]p„(fc)/(fc) 

k 

t-1 

k j=0 

t-1 



k2^ 
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j=0 a=0 

mi. 



Also note 

k 



t-i 

3=0 

(Note that the expressions for Ep^ (/) and i?p„ (//) in the proof of Theorem 2 
of [T] have some minor misprints.) 

The (complex) variances of / under U and P„ are Var[/(/) = t and 

Varp„(/) = Ep^{\f-Ep,Xf)?) 

- Ep.ifJ) - EpJf)Epj7) 

Like [1], we use the following complex form of Chebyshev's inequality for any 
Q: 

' 2 



where a > 0. Thus 



X : |/(x) - EQ{f)\ > a^VarQ(/)|^ < l/a^ 



and 

Let A and i? denote the complements of these 2 sets; thus U{A) > 1 — l/a^ and 
Pn{B) > 1 - If A and B are disjoint, then ||P„ - C/|| > 1 - l/a^ - 
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Suppose r is an integer with 



2iog(i/|ni|) 

where A ^ oo as t -> oo but A < \ogt. Then t\IiiY = t^/'^\Ili\-^ > t^/^. 
Observe that the fact a, 6, and c do not satisfy the conditions in Case 1 imphes 
I Hi I is bounded away from as t — > oo. Furthermore jllil is bounded away from 
1 for a given a, 6, and c. 

In contrast, let's consider what happens to jllil if a, &, and c do satisfy the 
condition in Case 1. If 6 = 1/2, then the a = t — 1 term in the definition of Hi 
converges to as t — > cx) and thus Hi also converges to as t — > cxo since each 
other term has length at most 1. If a = c = 1/2 and 6 = 0, then the a = t — 2 
term in the definition of Hi converges to as f — > oo and thus Hi also converges 
to as t cxD. 



Claim 1 



1^/ n, 



t ^ V|ni| 



as t 



Note that this claim implies (Varp^ (/))^/'^ — o{Ep^{f)) and thus Case 2 of 
Theorem [T] follows. 

Note that Hq = 1. By Proposition [T] below, 11^ = Ut-j. Thus tJ2^~^lirj is 
real. Also note that since Va.rp^{f) > 0, we have 



t2|niP'^ 

Thus to prove the claim, it suffices to show 

t-i 



' > 1. 



Proposition 1 Ilj = Ilf-j. 
Proof: Note that 



and 



^^-(2^(2'-^-!)) 



/3=0 
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If j < /? < t - 1, then note 

2/3(2*-i-i) = 2'^~^{2*-2^) 

= 2^5-^(1 -2^') (modp) 

= -2^J-i(2^ - 1). 

Thus the terms in Ht-j with j < (3 < t — 1 are equal to the terms in IIj with 
< a < i - j - 1. 

If < /3 < j - 1, then note 

2P{2'-3-\) = 2*+'3(2*-^' - 1) (modp) 

= 2*+^"J'(2* - 2^) 

^ 2*+^-J(l -2^) (modp) 

= -2*+''-^(2^' - 1). 

Thus the terms in Ht-j with < /? < j — 1 are equal to the terms in IIj with 
t-j <a<t-l. □ 
Now let's prove the claim. Let G{x) = jae^^" + b + ce"^'^'"^!. Thus 

t-i 

|n,HnG(2"(2'-i)/p)- 

(1=0 

Note that if < a; < y < 1/4, then G{x) > G{y). On the interval [1/4,1/2], 
where G increases and where G decreases depends on a, b, and c. 

We shall prove a couple of facts analogous to facts in [1]. 

Fact 1: There exists a value to (possibly depending on a, 5, and c) such that 
if i > to, then |nj| < |ni| for aU j > 1. 

Since G{x) = G(l — x), in proving this fact we may assume without loss of 
generality that 2 < j < t/2. Note that 

/ Ql-^j 2^ \ T— r (2}'^^^^ 2} 



i=0 

We associate factors x from jlljl with corresponding factors 7r(a;) of jllil in a 
manner similar to that in [Ij. For 0<j<t — j — 2, associate G((2*+'' — 2*)/p) 
with G(2*+J-7p). Note that for < i < t - j - 2, we have G((2*+J' - 2*)/p) < 
G(2*+J-Vp). For < i < j-3, associate G((2'+*~^ -2*)/p) in IH^I with G(27p) 
in |ni|. Note that for < i < j - 3, we have G((2*+*-^ - 2^/^) < G{T/p). 
The remaining terms in 1 11^ | are 

and the remaining terms in jllil are 



P J VP 
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It can be shown that since 6 > 0, 



G 



hmsup / \ / \ / 



M 

< ^:7TTT < 1 



G(0) 



where M = sup^g[;^/4_;^/2] Note G(0) = 1. To sec the fact that M < 1 

if 6 > 0, consider H{x) = \ae^^'^ + b\ if a > 0. H{x) is decreasing on [0, 1/2], 
and a + 6 - -^(1/4) > 0. For x G [1/4, 1/2], we have G{x) < H{x) + c = 

1 - (a + & - H{x)) < 1 - (a + 6 - F(l/4)). If a = 0, then c> and a similar 
argument involving jce"^^*"^ + b\ applies. Indeed, for some to, if t > to and 

2 < j < t/2, 



a 



< G 



2t-i _ 2*-J-i 



G 



G 



G 



2*-i _ 2^- 
P 

2i-2 



G 



2«-2 _ 2^- 



□ 

Fact 2: There exists a value ti (possibly depending on a, h, and c) such 
that ii t > ii, then the following holds. There is a constant Cq such that for 
t^'^ <j< t/2, we have 

in,-| CO 

|ni|2 - ^ 2J 

To prove this fact, we associate, for i = 0, 1, ,i — 1, the terms 



G 



2'-'-J- _ ')■'- 



G 



in llljl with the terms 



G 



in ]nip. Suppose A = max|G'(a;)|. Note that A < oo. Then 



G 



it-i-l 









) 


< 











,2^ 



-i-l 



Thus 



Likewise 





'2*-*-i-2^-*-i^ 











< 1 + A- 



2J- 



''I 


2t-i-l_2t-j- 






-) 









p 



<1 + A- 



2t-j-i-l 



G 



(^) 
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Since we do not have the conditions for Case 1, there is a positive value B and 
value t2 such that if t > is, then |G(2*-'-Vp)| > B for all i with 0<i <j -I. 
By an exercise, one can verify 



.t-i-1 _^t-j-i-l 



G 



<1 + ^ 
- 2J 



for some value C3 not depending on j. 

Note that the remaining terms in all have length less than 1. The 
remaining terms in \Tli\'^ are 



n 



G 



-)t-i-l 



Since G'(0) = 0, there are positive constants C4 and C5 such that 



G 



> 1 - C4 



for i > j > t^/^ . Observe 



> exp -C5 



n 



exp -c, 



it-i-l 



exp -C5^2*-*-Vp 

exp ("-cs ^ 2Vp^ 
\ fe=o / 



exp -C5 



2*^-'J - 1 



2* - 1 



2*-!' 

exp(-C5/2^') > I-C5/2J. 



> exp y ~C5 — 



There exists a constant cq such that 

1 + C3/2^' 

(1 - c^/vy 

for j > 1. 

Thus, as in [1], 



< 1 + co/2^' 



E 

tl/3<j<t/2 



in, 



inil 



1*1/3 ^ r,tl/4 
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for values cg and cy. Since jlljl = |nt_j|, 




= l + o(l) 



as t (X. Thus Fact 2, the claim, and Theorem [T] if 6 > are proved. 

If 6 = 0, Theorem [T] can be proved by considering the following random 
processes on the integers mod p: 



1. = 


and Xn+i 


— 2X„ 


+ (mod p) where 


= 1) = a 


and 


Pibn = -1) 


= 1 - a 










2. Yo = 


and Yn+i 


= 2y„ 4 


- dn (mod p) where P{dn 


= 2) = a 


and 


P{dn = 0) = 


1-a 










3. Zo = 


and Zn+i 


= 2.Z„ - 


K e„ (mod p) where P(e„ 


= 1) = a 


and 


P(e„ = 0) = 


1-a 










If P„(s) : 


= Pr{Xn = s\ 


), Qn{s) 


= Pr(y„ = s), and i?„(s) 


= Pr(Z„ = 





then ||P„ — U\\ — WQn — U\\ — ||i?„ — U\\. To see this, we can let d„ = 2e„ and 
bn = dn — 1 so that F„ = 2Z„ and Xn = Yn — J2^=o 2"' for n > 1. To conclude 
the case where 6 = 0, use the argument with 6 7^ on the third random process 
(provided that a 7^ 1/2 so that we are in Case 2). 

□ 

The next proposition considers what happens as we vary the values a, 6, and 

c. 

Proposition 2 If a = c = /3 and 6=1 — 2/3 and mp — liminft^oo |ni|, then 
lim^^o+ mi3 = l. 

Proof: Suppose /3 < 1/4. Then 

ni = n ~ 2/3) + 2/3cos(27r2"/p)) . 

Let h(a) = (1 - 2/3) + 2/3 cos(27r2"/p). Note that 

lim h{t - 1) = 1 
lim hit - 2) = 1 
lim h(t-3) = 1 

Furthermore, for some constant 7 > 0, one can show 

h{a) > exp(-/?7(27p)') 
if 2"/p < 1/8 and < /3 < 1/10. So 

llh{a) > n exp(-/37(27p)') 

Q=0 a=0 
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exp -/37^(2"/p)2 



\ a=0 / 

> exp(-/3722(*-4) (4/3) /p2^ ^ i 

as/3^0+. □ 
Recalling that 

21og(l/|ni|) ' 

we see that l/(21og(l/|ni|)) can be made arbitrarily large by choosing (3 small 
enough. Thus there exist values ^ oo as /3 ^ 0"*" such that ii n < 
C/3(logp)log(logp), then - U\\ ^ I a.s t ^ cg. 



5 Problems for further study 

One possible problem is to see if in some sense, there is a value of (3 on [1/4, 1/2] 
which maximizes the value of N required for [iP^v — U\\ ^ Q\ to consider such a 
question, one might restrict p to values such that p = 2* — 1. 

Another possible question considers the behavior of these random processes 
for almost all odd p. For /3 = 1/3, Chung, Diaconis, and Graham [1] showed 
that a multiple of logp steps suffice for almost all odd p. While their arguments 
should be adaptable with the change of appropriate constants to a broad range 
of choices of a, 6, and c in Case 2, a more challenging question is to determine 
for which a, &, and c in Case 2 (if any), (1 + o(l)) logjp steps suffice for almost 
all odd p. 
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